#transformer alternative

Meta AI researchers have developed AU-Net, a scalable byte-level autoregressive U-Net model that outperforms traditional token-based transformers across multiple language modeling benchmarks, offering faster and more efficient text generation.